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SUMMARY 


This report presents a comprehensive discussion of the problem 
of singular control. Singular control enters an optimal trajectory when 
the so-called switching function vanishes identically over a finite time 
interval. 

Using the concept of domain of maneuvrability , the problem of 
optimal switching is analyzed. Criteria for the optimal direction of 
switching are presented. The switching, or junction, between nonsingular 
and singular subarcs is examined in detail. It is shown that, in general, 
switching with singular arcs falls into one of two categories: a regular 
type where the control is discontinuous at the junction point, and a singular 
type where not only the control is discontinuous at the junction point, but 
is non-analytic. In this type of junction, entering or leaving a singular 
arc is effected by chattering control. 

Junction between nonsingular and singular subarcs in which the 
control is continuous at the junction point is a rare phenomenon and 
usually is effected at some specified points in the phase space. This will 
require particular initial and final manifolds. Several theorems concern- 
ing the necessary, and also sufficient conditions for smooth junction are 
presented. 

The concepts of quasi- linear control and linearized control are 
introduced. They are designed for the purpose of obtaining approximate 
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solution for the difficult Euler- Lagrange type of optimal control in the 
case where the control is nonlinear. 

Some illustrative examples are presented as applications of the 
theorems formulated and of the concepts introduced. 
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I. INTRODUCTION 


Optimal control problems in which the control variables appear 
only linearly admit the possibility of the existence of singular extremals. 
Along a singular optimal subarc the so-called switching function is identi- 
cally zero and necessary condition for optimality is established by 
considering higher order variation of the Hamiltonian. In recent years, 
this problem of singular control has been studied by a number of authors 
[ 1-14] . The case is now no longer considered as just a mathematical 
singularity, as its name suggests, but because of frequent occurrence of 
optimal singular subarcs in trajectory optimization, singular control has 
become a reality and the inclusion of such subarcs in the overall optimal 
trajectory has to be considered. This, in turn, leads to the investigation 
of the problem of joining optimal singular and nonsingular subarcs [ 15-18] . 

On the other hand, the physical nature of the engineering problems 
encountered suggests that the linearity of the control variables in the 
majority of the cases is merely an approximation in mathematical modeling. 
Hence, although sometimes a singular solution is obtained through the use 
of linear control, the true solution to the physical problem is nonsingular 
since the control is nonlinear, or at most quasi-linear. It is then inter- 
esting to investigate the real physical problem that is quasi-linear in the 
control and analyze the solution which can be termed as quasi- singular. 


Finally, one of the well established techniques for stability 
analysis is through the linearization of the equations of motion about a 
certain known solution, usually steady state solution, called the reference 
solution. The brilliant works of Poincare [19] and followers [ ZO] in 
establishing periodic solutions in the three and many- body problems, and 
also in space dynamics [ 21, 22] , are testimonial of the usefulness of the 
approach. It is enlightening to use linearization in purely nonlinear control 
problems. One can then assess the behavior of the control about a certain 
solution. Furthermore, if this solution is near optimal, then linearization 
is a proven technique which allows one to obtain improved solution as long 
as the near optimality of the reference solution is valid. 

The outline of this report is as follows. After this introductory 
section, optimal control problem using the notion of domain of maneuvra- 
bility is discussed in Section II. If certain components of the control 
vector enter the equations of motion linearly, the domain of maneuvrability , 
which is bounded by a hypersurface, has a portion of its boiindary being a 
ruled surface on which the optimal control is singular. The problem of 
switching from one control to another one is investigated and the condition 
for a smooth junction between singular and nonsingular subarcs is established. 
In Section III, optimal control problems in which the control is quasi-linear 
is studied. The quasi- singular solution is obtained by the construction of 
a switching function and the fact that the junction between nonsingular and 
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quasi- singular subarcs is continuous is established. In Section IV, the 
technique of linearization is applied to investigate the behavior of the 
optimal control near a given solution. It is shown that through the 
linearization of the Hamiltonian near a suboptimal solution, a better 
solution can be obtained. In Section V, some applications of the theory 
to trajectory optimization are given and, finally, in the last section. 
Section VI, a summary of the new results and their usefulness in solving 
optimal control problems is presented. 


II. SWITCHING THEORY 


Consider a dynamical system defined by a n- vector x subject to 
the differential constraint 

X = r ( X, u , t) (1) 

where u is an m- control vector belonging to a certain control space U 


u e U ( X , t) (2) 

It is proposed to find the optimal control u * , as function of 
time, to bring the system from a certain initial manifold to a certain final 
manifold such that a certain final component of the state vector is minimized. 
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II. 1 . Selection of The Optimal Control. 


Following Contensou, we define the natural domain of maneuvrability 
D(x , t) at the time t, with state vector x , as the reachable domain in the 
hodograph space [ 2-4] 

V=x = f(x,u,t). (3) 

Introducing the n-adjoint vector p , the optimal trajectory is 
obtained by selecting, at each instant t, the control vector u* in the 
control space U such that 


u * = arg sup H , or H* 

u e U 


sup H 
u e U 


(4) 


where the Hamiltonian H is defined by 

H = p . r = p . V . (5) 

In the domain of maneuvrability (Fig. 1), the optimal condition 
(4) leads to the selection of the optimal operating point M* such that the 
projection of the vector V * = OM * on the adjoint vector p is 

maximized. The point M* is necessarily on the boundary G of D. Only 
the convex portion of the boundary G can be used optimally. The concave 
part of the boundary has to be completed by the smallest convex ruled 
surface. In this case, the convex ruled surface is artificial. In the case 
where certain components of the control vector u enter the equations (3) 
linearly, there exists a natural, ruled part of the domain of maneuvrability. 
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Fig. 1. Selection of The Optinaal Velocity In The 
Domain of Maneuvrability. 

II. 2. Switching of Optimal Control . 

Consider a rectilinear part of the smallest convex domain D of 
the domain of maneuvrability D. This part can be natural R, or artificial 
R by convexizing. The convex domain D and the adjoint vector p vary 
with the time t. There may exist a time t such that, through the ruled 
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part R, or R , the optimal operating point changes brusquely from 

M to M . At that point, the optimal control changes from u to 
X 2i X 

o o 

u^* . We have a switching of the optimal control. 

The sequence in Fig. 2 shows a switching . If the 

o o 

sequence of the events is in the reverse direction, we have a switching 


o o 



Fig. 2. Optimal Switching 

o o 

To study the direction of the switching, we consider the convex 

parts and of the boundary G of D near of the point and 

o o 
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I 


respectively. Near the switching point, the optimality condition leads to 
the selection of the operating point, either on , with the velocity 
or on G , with the velocity V (Fig. 3). 

C* w 

Let 

V = (1-X) + X = (1-X)r(x,u^,t) + xr(x,U 2 ,t) (6) 


where and the values of u corresponding to the point £ G^^ 

and respectively. By varying X in its interval X £ [ 0, 1 ] we 

obtain all the points M on the segment which is obviously within 

the convex domain of maneuvrability D. The parameter X, introduced 
artificially as defined in Eq. (6), constitutes a normalized linear control. 
We observe that, near the switching point, the optimal value of X is 
either X = 0 , point , or X = 1, point M^. Hence, it sirffices to first 
select and u^"' , and then the optimal value X* to have the optimal 

velocity V*. We have 


u ^ * = u ^ ( p , x , t) 

u^* = u^*(p,x,t) 


arg sup 
£ G^ 

arg sup 
M^£ G^ 


with the corresponding maximized Hamiltonians 


Hi* = H^* (p, x.t) 


sup 

M, 


H 
£ G 
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Fig. 3. Domain of Maneuvrability Near a Switching 

Discontinuity. 
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sup 

^^ 2 " ^2 


Since H = p . V , we have the Hamiltonian by using Eq. (6) 


H = (l-\) H * + \ H * 

X ^ 


( 7 ) 


To maximize H with respect to X , we have the following optimal solution 


“ “ It = s « 


At the time of the switching , we have 


= 0 


m 


Furthermore , the switching is from to if at that time 


dt <^2* - ^l") > ° 


( 9 ) 


If the inequality is reversed, the switching is from to 
We define the switching function 


$ = = $ (p , X , t) 


( 10 ) 


At the switching point, ® = 0. It suffices to analyze the sign of d$/dt 
at ^ = 0 to determine the optimal direction for switching. In this 

respect we write the maximizcid Hamiltonian 


H* = (1-X*)H * + \*H * = H * + X* $ 

L w X 


( 11 ) 
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Now, consider an arbitrary f\anction F = F(p ,x ,t). Its total 


derivative is 


dF 

dt 


3F dp 


9p 


dt 


8F dx 
0x 


0F 

0t 


Since along an optimal trajectory 
^ dp _ 


dx 

dt 


0H* 

0p 


dt 


0H^ 
0 X 


( 12 ) 


we can use the Eq. (11) to write the derivative of F 


dt 


0F 

0p 


0H^* 

0^ 


+ 


0F 

dx 


9H, * 

1^ ^ 

Op ^ dt 


+ X 'r 


/9F 

,9x 


9 $ 
9p 


IE 

dp 


9 $ 
0x 


(13) 


We define the temporary derivatives D^F = dF/dt^^ , ~ dF/ dt^ of 

a function F as the derivative of F using the Eq. (12) as generated by the 
Hamiltonian and respectively. Then the derivative DF = dF/ dt 

has the form 


DF 


D^F + \=!= 


1 9F 9 $ 
\9x d^ 


9F 9 $ \ 
9p 0x ' 


(14) 


Since OF/ 9t = 9F/ 9t , we can write the coefficient of in this 

M ^ 

equation 
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9F 

9 $ 

9F 

9^ 


9H2=^ 

9F 

9H^=^ 

1 

9F 

9x 

— ► 

9p 

9p 

9x 

\ 9x 

9p 

9p 

T 

9x 

9t^ 





/ 

9Hj* 


aF 






” \ 9x 

3p 


9p 9x 

1 




= 


D^F 


• 



IF 

9t 


i) 


Hence, we can write Eq. (14) in the operational form 


DF = DjF + X^iMD^F - D^F) 


(15) 


valid for any arbitrary function F along an optimal trajectory. 

When F = the condition (9) coupled with E q. (14), provides the 
condition for a switching from M to M 


D$ = = 


dt. 


~Tt~ 


> 0 


( 16 ) 


This condition, first derived in [ 18] , is a generalization to nonautonomous 
system of the condition given in [ 23 ] . (Application of this switching 
condition will be given in Section V. ) By comparing the Eqs. (14) and (15) , 
we see that, for F = , the coefficient of X * is zero and we have 


D ® = D 

X w 


( 17 ) 


Hence the equivalent condition for a switching from to is 


dH^* 

dt^ 


9H^« 


< 0 


(18) 
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In the case where D $ = D, $ = D_ $ = 0 at the time t of 

12 o 

the switching, the direction of the switching is decided upon analyzing 

higher order derivatives of the switching function. The successive 

derivatives of $ may contain the control which is discontinuous across 

the switching point so that in the neighborhood of the time t = t^ , the 

switching function is not analytic. To circumvent the difficulty, we 

consider separately the development $ and $ of the function 

respectively in the neighborhood of the points and as a series 

o o 

expansion. Then 




n. 


(t-y 

’1 n^! 


n. 


"h • . • 


(t - 1^) 

^ 2 ^') ^ ^2 + 


(19) 


where 


B. 


n. 


$ 


t = t 


i 0 


B. 


°2 ® 


t=t 


0 


( 20 ) 


and n and n are the order of the first non zero successive derivatives 

X U 

at the time t = t . The direction of the switching depends on the orders , 


odd or even, of n^^ and n^ and the signs of Bj^ and B^. In the neighborhood 

of t = t , the plots of the function $ and are one of the four types 
o 12 


- 12 - 



shown in Fig. 4. These four types are denoted by I k and II k, k=l,2,3,4 
with the definition given in Table 1 for the types Ik. 


Table 1 



Fig. 4. Plots of $ and $ in the Neighborhood of t 


We distinguish two cases: 


The Regular Case 

This is the case where the first non zero successive derivative 

does not contain the control. The orders n^^ and n^ on the one hand, and 

the coefficients B and B on the other hand are identical. The possible 
X 2 

switchings are the following: 


(1 1 , 

II 1) 

J 

Ml 

M 

(I 2 , 

II 2) 

: 

Ml 

M 

(I 3 , 

II 3) 

: 

^2 

M 

(I 4 , 

II 4) 

; 

M2 

-* M 


The proof is simple. For example, we consider the case (II, II 1) 

of Fig. 5. We see that before the time t = t we must take ® = $, since 
® o 1 

$ = H * - H * < 0, that is H * > H * in agreement with the 

X w X X 

maximum principle, and after the time t = t , we must take $ = for 

o 2 

^ = H - H > 0, that is H * > H . The switching is then 

^ Ct X. X 

from to In this regular case, the switching occurs at the junction 

between two nonsingular subarcs. The cases (II, III) and (13, II3) are 
the ordinary switchings and the cases (12, II 2) and (14, II 4) are the 
false switchings. 
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Fig. 5. Switching in the Case (I 1 , II 1) , -► . 

The Singular Case 

This is the case where upon successive differentiation, the first 
non zero derivative contains the linear control X*. In general, this case 
corresponds to a junction with a singular arc as will be apparent from the 
discussion below. 

We have seen that, at all time t 

D $ = <& = $ . (21) 

By taking the derivative of this equation, using the operational 
relation (15), we have 
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( 22 ) 




It may occur that the coefficient of \ * vanishes identically. For 
this case, we have for all t in a closed interval containing t 


2 2 2 
D $ = # . 


(23) 


Continuing the operation until the coefficient of does not 
vanish identically, we have 


Ic Ic Ic Ic 

D $ = (D^ $) , 


(24) 


In the case where u enters linearly the differential constraint (1), 
Kelley has shown in Ref. [5] that in taking the successive derivative of 
the switching function, the linear control appears for the first time only 
with an even derivative k = 2q, where q is the order of the singular arc. 
This is also true with respect to the artificial normalized linear control 
\ in the present formulation where u can be non-linear. A simple 
proof of this property can be found in Ref. [ 18] . 

In STommary in the singular case, we have n^ = n^ = 2q, 

^ the neighborhood of a singular arc, the derivative 

of the switching function $ is 




(25) 
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k k 

with all the D $ = D $ for k < 2q - 1. Furthermore, all these 

X u 

derivatives vanish at t = t^. The integer q is called the order of the 
singular arc. 

Let 


2q 

B = D $ 
1 1 


t = t 


2q 

B = D ^ $ 

2 2 t = t 


(26) 


and consider first the simplest case where B^^ 7 ^ 0 and B^ / 0. 

If B. and B have the same sign that is if B B > 0 , then since 

X ^ X C* 

n = n = 2q, we have the false switching cases (I 2 , II 2) if B < 0 
X 2 X 

and (14, II 4) if B^ > 0 , with -► for Bj^ < 0 and -»• 

for Bj > 0 respectively. As can be expected, these cases are rare. 

If B and B have different signs, that is if B B < 0, we 

Xu Xu 

distinguish two cases. The first case is B < 0 , B > 0, hence it is the 

X u 

case (12, II 4) as shown in Fig. 6. This case has some ambiguities. We 

can take either or $ before t and also either or $ after t . 

1 2 o 1 2 o 


Furthermore, by writing 


® = ( 1 - X*) + X* (27) 

since and have different signs, we can select X*e[0,l] to 

make ® identically zero before or after t^. If the rectilinear part of 

the domain of maneuvrability is natural, R, X* has an intermediary 

value between 0 and T, the arc is a singular arc . If the rectilinear part 

is artificial, R, obtained by convexizing, we can render $ identially 

zero by switching rapidly X* between 0 and 1; the arc is a chattering arc. 
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where S denotes the singular arc, either natural or artificial by chattering. 
In practical applications, the ambiguity is removed by considering the 
initial and the final conditions. 

There remains the case where B > 0, B < 0, that is the case 
(14,112) as shown in Fig. 7. 


to 


' 


Fig. 7. Switching in the Case (14, II 2). 


This is the case of singular switching. The junction between 
subarcs is connected in a singular manner. In this case, immediately 


before and after the time t , we cannot take $ = for any finite time 



interval for > 0> that is , in violation of the maxim\im 

principle. On the other hand, for the same reason, we cannot take 

$ = $ . The only natural possibility is to combine and $ to make 

$ = 0. By Eq. (27), since and have different signs, if the 

rectilinear part of the domain of maneuvrability is natural, has an 

intermediary value in its interval X*e [ 0, 1] . The arc before or after, 

or both before and after the time t is a singular arc. If the rectilinear 

o ® 

part is artificial, obtained by convexizing, X.* can only have the value 
0 or 1 , we can render $ = 0 by switching X.* rapidly between its extreme 
values. The arc is a chattering arc. 

The chattering arc can occur with a linear control, that is for a 
natural rectilinear part of the domain of maneuvrability. Referring to 
Fig. 7, we consider the case where the trajectory is not totally singular 
in a time interval t e f ’ ^2 ^ containing t^. Let us assume that the 
singular arc occurs after the time t^. By assumption, before t^, the 
arc is not singular, obtained by using an intermediate value of \ . 

Also since neither nor can be used for any finite time interval, 

the entering of a singular arc at t = t^ can only be obtained, with $ 
neither positive, ^ nor $ negative, $ = , that is with $ = 0, 

by rapid switching of \ * between its limits 0 and 1 . The same arguments 
apply when the trajectory leaves a singular arc. In this case, although 
the control is linear, with the possibility of using an intermediate value 
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singular 

switching 


M2 ^ M 2 

M2 M2 

s-*s 


M2-M^ 




Remark 


Table 2. Optimal Switchings. 
(B^ i 0, ^ 0, n^^ = n^ < 2q) 


Table 2 is not complete in the sense that it does not present all 
the possible cases of optimal switching. The reason is that Table 2 is 
restricted to the case 


9 ^ 0 , 0 


L. 

















where and are the first non vanishing values of the derivatives 
evaluated at t = t for an order n, = n < 2q where q is the order of 
the singular arc. Nevertheless, it will be shown in the following that the 
condition (28) is generally satisfied. Under this condition, junction with 
a singular arc only occurs in two cases. In case (14, II 2), entering or 
leaving a singular arc is effected by chattering control with increasing 
frequency as t approaches t^. 

To clarify the meaning in subsequent analysis we use the following 
definitions as given in [ l6 ] ; 

Definition 1 . A real- valued function g is said to be piecewise analytic 
on an interval (a,b) if for each t^ € (a,b), there exist t^^ e (a, t^) and 
t^ € (t^, b) such that g is analytic on the open subintervals 

(^o’V- 

Definition 2. A junction between singular and nonsingular subarcs of the 
control is said to be a nonanalytic junction if the control is not piecewise 
analytic in any neighborhood of the junction. 

From the Definition 1, chattering control is not piecewise analytic 
in the neighborhood of t^ and the junction in case (14, II 2) is a nonanalytic 
junction. 

On the other hand, in case (12, II 4) where junction between singular 
and nonsingular arcs is also possible, the normalized control is 
either \ * = 0or\* = 1 on the nonsingular arc, and from Eq. (30), is 
given by 
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0 


(29) 


= 

on the singular arc. At the junction point, we have 

- B^) = 0 . (30) 

Since this is the case where < 0 and B^ > 0, it is clear that at the 
junction point, on the singular side, X * is specified by 0 < X* <1. Hence 
the control is piecewise analytic but is discontinuous at the junction. 

II. 3. Junction With Singular Arc. 

By a systematic discussion of optimal switching, we have seen that 
junction with singular arc is usually through chattering control or if the 
control is piecewise analytic, it is discontinuous at the junction. It remains 
to investigate the cases where the control is continuous, or even smooth 
at a junction between nonsingular and singular arcs. In this respect 
several interesting theorems have been formulated by McDanell and 
Powers [ 16] . The objective of the present analysis is to complement 
their results for non symmetric control and to supply additional rules with 
practical applications. From now on, we shall restrict ourselves to the 
case where certain components of the control vector u enter the equations 
of motion linearly. Also, at any given interval, on the singular arc, 
there is only one linear component of the control that is singular. If u(t) 
is that component, then u e U(x,t), or explicitly 



(x.t) < u < (x.t) 


(31) 


We shall rule out the trivial case where at the switching point t = t^ 

K,(x(t ).t ) = K (?(t ).t ) . (32) 

loo Zoo 

Then obviously B = B and we either have a false switching or a 
regular switching between non singular arcs with the control being 
continuous at the lunction t = t , u(t ) = K, = K^. 

We continue to use our normalized linear control X* and the 
temporary differential operators and which prove to be very effective 
in formulating practical rules for continuous control across a junction. 

Along a singular arc, the switching function vanishes identically. 
Hence, from Eq. (25) we constantly have 

$ = AX*+ C = 0 (33) 


where 


A 

C 


Cd X 


2q 


(34) 


Equation (33) can be solved for the singular control X*. The 
necessary condition for optimality of a singular subarc derived by Kelley 
and Contensou [ 3-5] , also called the generalized Legendre- Clebsch 
condition states that 
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I 


Theorem (Generalized Legendre- Clebsch condition). On an optimal 


singular subarc of order q, it is necessary that 


(- 1 ) 


q 


8 

d^'l 

[8H* 1 

8X* 

dt^^ 

lax* ) 


< 


0 


( 35 ) 


In the present formulation, it is expressed by the condition 


(-1)^^ A < 0 


(36) 


In the following, we shall refer to the condition as the GLC condition 
and by the strengthened GLC condition we mean that strict inequality holds 
in (36). 

First, we have seen that, under the condition in Table 2, the 
control at a junction between singular and nonsingular subarcs is 
discontinuous. 

Hence, we have 


Lemma 


Let 




0 


t=t 




i 0 


t=t 


(3 7) 


be the first non vanishing derivatives evaluated at a jvmction point between 
a nonsingular subarc and a singular subarc of order q. Then, a necessary 
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condition for the control to be continuous at the jxinction point is that 
either r >0 or r > 0 or both r > 0 and r > 0. 

Xu Xu 

This simple rule is in fact very useful. In an optimal control 
problem in which optimal singular subarcs are suspected one can 
immediately single out the region where a continuous junction is possible 
by writing the necessary condition at the junction point 


$ (t ) = 0 

o 



t=t 

o 


0 


i = 1 or 2 
n = 1 , 2, . . . , 2q . 


( 38 ) 


This condition, together with other necessary conditions given 
below can restrict further the region where junction is continuous. Hence 
in general, continuous control at a junction point only occurs in very 
special cases. 

We can now prove the following main theorem. 

Theorem 1 . 

Suppose the strengthened GLC condition is satisfied at a point tQ, 
on an optimal trajectory, where a nonsingular control u- is joined with a 
singular control Ug. Let q be the order of the singular arc. Then, for 
the control to be continuous at t^, it is necessary that 
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/ 0 


(39) 


n-1 

D. $ 
1 


t=t 


= 0, D.^ $ 

1 


t=t 


i =1 or 2 
n = 1, 2, . . . , 2q + r 


where r > 0 and q + r is an odd integer. 


junction with a singular subarc, it is necessary that D 


1-1 


Proof: From the lemma, for the control to be continuous at the 

^lt=t = ° 

= 0 , 


for n = 1, 2, ... , 2q, and B = D ^ _ = 0 or B = D ® 

1 1 t“ t 2 2 


t=t 


o o 

The strengthened GLC condition prevents the case where both Bj^ and B^ 
are zero. On the singular side of the junction, the normalized singular 
control is given by 


B^ + - B^) = 0 . (40) 

If B|^ = 0, \ * (t^) = 0 and since, on the nonsingular side, = 0 

corresponds to Uj^(t), continuous junction is made with u^. Similarly, 
if B^ = 0 , =1 on the singular side and since on the nonsingular 

side =1 corresponds to u (t), continuous junction is made with u . 

This question of junction settled we next consider: 

a. Case of q even. If B^^ = 0, junction is made with u^^ and 
< 0 on the nonsingular side. Since q is even, by the strengthened 
GLC condition B < 0 and and the representative curve for $ is of the 
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type 112 (Fig. 8). For singular arc to exist and rnust have 
different signs on the singular side. Therefore > 0 on the singular 
side and the representative curve for has an inflection point at t = t^ 
The function in the neighborhood of t = t^ is of the form 


(t) = 


(t-t ) 
o 


+ • • • 


where 


Bi = Dj" * 


i 0 


and n = 2q + r is an odd integer. Hence, r is an odd integer and q + r is 
an odd integer. 




singular arc 


Fig. 8. Switching in the Case (II, 112) 



We notice that the curve is of the type II or 13. If > 0, it is of 
the type II as shown in Fig. 8 and the switching is -*• S. If < 0 
the curve is of the type I 3 and the switching is S . 

Similarly, if B = 0, junction is made with u and $ > 0 on the 

Ct b (U 

nonsingular side. Since q is even, by the strengthened GLC condition, 

Bj > 0 and the representative curve for is of the type 14 (Fig. 9). 

For singular arc to exist, and must have different signs on the 
singular side. Therefore < 0 on the singular side and the representative 
curve for has an inflection point at t = t^. In the neighborhood of 
t = t^, the series expansion of is of the form 


= B. 


(t-t ) 
o 


n 


+ • » » 


(43) 


where 


B. 




t=t 


(44) 


and n = 2q + r is an odd integer. Hence q + r is an odd integer. 

We notice that the curve ® is of the type III or II 3. If B <0, 

w 2 

it is of the type II 3 as shown in Fig. 9 and the switching is S. If 

B > 0, the curve is of the type III and the switching is S -* M . 

Ld Cm 

b. Case of q odd. If B = 0, junction is made with Uj^ and < 0 
on the nonsingTolar side. By similar arguments, as carried above, we can 
deduce that B^ > 0 and 0 on the singular side. Hence the curve 
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Fig. 9. Switching in the Case(I4, II3) 


$ is of the type 12 and the curve is of the type II4 as shown previously 
1 4 

in Fig. 6. In this case, in the neighborhood of t = t , the series expansion 

o 

of is given by Eq. (41) with < 0 and n = 2q + r is an even integer. 

Therefore r is even and again q + r is an odd integer. 

Similarly, if B = 0, continuous junction is made with u and 

we have the same case (I2,II4)with B^^ < 0, B^ > 0. In the neighborhood 

of t = t , the series expansion of ® is given by Eq. (43) with n = 2q + r 
o 2 

being an even integer. Hence q + r is an odd integer. 

The results of discussion, in terms of the direction of switching. 


are summarized in Table 3 below. 
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Ill 


nz 


1 1 


M^-S 
q even 


12 


13 


* 


S-M^ 
q even 


14 

S-.M^ 
q even 


113 


II 4 


* 


M Ml 

Ma Ma 


Jdd 


M^-.S 

q even 


Table 3. Optimal Switching, (-1) < 0. 


Remarks . 

As compared with Table 2, we have 4 new cases of junction with 
singular arc for q even. For the case of q odd we have the same 
ambiguities as in Table 2. The difference here is that since the first 
non- vanishing derivative, either for or , occurs for an order n > 2q, 
there is a possibility of continuous control at the junction with the singular 
arc. In other words, if = 0, the switchings S and S -*• are 

continuous, while the other two possible switchings S and S -*• 

are discontinuous. Similarly, if = 0, the switchings M^ -* S and 


S -»• M are continuous, while the two other possible switchings M -► S 
















and S -*• Mj^ are discontinuous. Theorem 1, for q odd only provides the 
necessary condition for continuous junction. On the other hand, for the 
case of q even, as shown in Table 3, not only that continuous junction 
between nonsingular and singular subarcs is established but the direction 
of the switching is xiniquely determined. Hence, we have 


Theorem 2. 


For a continuous junction between nonsingular subarc and singular 
subarc of an even order, the condition in Theorem 1 is also siafficient. 
Furthermore, the conditions for entering /leaving the singular subarc are 


(i) = 0 , 

o 

AV 

)PQ 

(45) 

(ii) = 0 , 

< 0 . 

(46) 


Of course, in the theorem, condition (i ) applies to junction with 
Uj and condition (ii ) applies to junction with u^ while the upper inequality 
sign is for entering and the lower inequality sign for leaving the singular 
subarc. 

We now can prove the following important theorem, first discovered 
by McDanell and Powers for symmetric control [ 16] . 

Theorem 3. 

Under the condition in Theorem 1 and, in addition, if the control 
is piecewise analytic in a neighborhood of t^, then r is the lowest order 
derivative of u which is discontinuous at t^. 

Proof; The normalized linear control is related to u by the 

relation 
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II 


u = (1 - (47) 

where 

(X . t) 

= K2(x,t) . (48) 

The analyticity o£ u implies the analyticity of and K^. which in turn, 
from Eq. (47) implies the analyticity of X * . In fact, for the proof we 
only require that X* possesses successive derivatives up to a certain 
order r. We define 

Q'(t) = ^ = F(p,x,t) 

(3(t) = = G(p,x,t) (49) 

and write the equation (29) 

Q-(t) = -X* (3(t) . (50) 

This equation is constantly satisfied along a singular arc, and since X* 
possesses successive derivatives up to a certain order r, we have 

= - ± 
i=0 

X 

where ( ^) are the binomial expansion coefficients. Equation (51) is in 
the form for the proof in the case of jiinction with u^ , X*!* = 0. By 
writing the condition (39) in Theorem 1, for r = 1 , 2, . . . , and noticing 
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Of course, when r = 0 we have the condition of the lemma, that is, of 
Table Z, and the control is discontinuous. 

Theorem 3 generalizes McDanell and Powers main theorem to 
nonsymmetric control. Furthermore, when used in conjunction with 
Theorem 1, not only that it predicts that the two- order q and r are of 
different types; that is, if q is odd, then r is even, and if q is even, r is 
odd; but also, in many cases, by using Theorem 1 we can actually compute 
the integer r without evaluating the singular control itself. This assess- 
ment will be illustrated by examples given in Section V. 
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To complete the anlysis, we shall prove the following theorem; 


Theorem 4. 


At the junction point between nonsingular and singular subarcs, 
the jump in the discontinuous r^^^ derivative of the control is given by 


. = ,u, - u^, 


D. 


Zq+r 


$ 


^ 2q 

D 2 ^ 


( 54 ) 


m 

for a junction with u^ = (x , t), and 


u = (u^ - U ) 

2 2 1 


Zq 
^ 4- 


(55) 


for a junction with u = K ( x , t) 


Proof; For a junction with u^ , evaluating the r^^ derivative of 


Eq. (47) at t = t , using the relations (5Z) we have 


u (u, - u,) . 

si cl 

1 


(56) 


On the other hand, from Eq. (51), at t - t 




(r) 


^ 7 ^ 


(57) 


Using (57) into (56), we have the relation (54). For jionction with u^ we 
can either use the transformation (53) or simply permute the indices in 
Eq. (54) to have Eq. (55). 
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m. QUASI - SINGULAR CONTROL 


In most engineering problems, the control is hardly linear. Most 
often, it enters linearly the equation of motion of a dynamical system 
through approximating in mathematical modeling. With such an approxi- 
mation, the optimal control, if it is not of the bang-bang type, is singular 
and hence at the junction point it is subject to discontinuity as discussed 
in the previous section. Although the singular solution obtained may be 
satisfactory, the true solution is nonsingular. It is then of interest to 
consider the real physical problem that is quasi-linear in the control and 
analyze the approximation necessary to obtain the intermediate solution 
which can be termed as quasi- singular. 

In this exploratory work, we shall restrict ourselves to the case 
of one single component for the control. 

The hodograph is given by 

• 

V = X = f (x , u, t) (58) 

where 

u^ < u < u^ (59) 

and Uj^ and u^ are two arbitrary functions of x and t as defined in 
Eq. (48). If the control u is linear 

V = f^ (x,t) + u ?” 2 (x,t) (60) 
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Fig. 10. Chattering Control For Nonlinear Control. 


and the domain of maneuvrability is a segment of a straight line (Fig. 10). 
If u is quasi-linear, the segment is quasi- rectilinear. We have two 


cases. 


If the domain of maneuvrability is concave as shown in a dashed line 


in Fig. 10, the control is either u* = u^ or u* = u^ depending on 


whether or 


where 
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* = p . f ( X , u t) 

r(x, u^.t) . (61) 

In the case where we have 

$ = - Hj"" (62) 


identically zero for a finite time interval, the resulting arc is a chattering 
arc. This type of control, also called sliding control, is studied extensively 
in [ 24,27] . The condition for chattering control is obviously, for a 
finite time interval 




^ 2 * 


(IH) 

9u 


0 . 


u=u. 


(63) 


It is more frequent that the domain of maneuvrability is convex 
(Fig. 11). The optimal control is either u* = u^ , or u'"'^ ~ ^2’ 
boundary type, or u^ < u=!= < u^. In the latter case, it is said to be of the 
Euler- Lagrange type. In this case, u* is obtained by solving 


8H 
9 u 


0 


(64) 


In general, we have 


u* = u* (p , X, t) 


(65) 
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If the equations for the adjoint vector p cannot be integrated analytically, 
the optimal control cannot be expressed in terms of the state vector x 
and possibly the time t, and usually ntxmerical solution has to be sought. 

In the case of linear control, because of additional relations from the 
equation $ = 0, n=0, 1, ..., 2q, we may obtain more information 
about the control, and even about the trajectory itself. Hence, in problems 
in which the control is quasi- linear , simplification is made by linearizing 
the control. In doing so, singular control may be obtained explicitly, but 
the equations of motion suffer in accuracy since they no longer describe 
the actual trajectory. Hence, it is better to maintain the exact equations 
with quasi-linear control and use approximate method to obtain near 
optimal solution for the control. 



Referring to Fig. 11, if the control is qua. si- linear, then the 


domain of maneuvrability is near rectilinear. This means that during the 
time interval where the control is of the Euler- Lagrange type 

H* « . (66) 

The optimal velocity V * can be approximated by 

V=i^ = (l-\*) (6 7) 


where is an intermediary value between 0 and 1 . This in turn leads 
to the approximation for the maximized Hamiltonian H* 

H* = (l-\*) . (68) 


The control is now linear and since X* has an intermediary value, it is 
singular. In other words, the Euler- Lagrange type of optimal control 
has been approximated by a singular type control. While the physical 
equations of motion are retained in their exact form for the purpose of 
evaluating the actual performance, the near optimal control, with the 
assumption of quasi-linear control, is sought using the approximate 
maximized Hamiltonian as given in Eq. (68). Using this Hamiltonian, we 
have for the state and adjoint equations, the canonical system 


dx 

dt 


9H>l< 


9P 


dp 

d t 


8H* 

— =5T“ 

9x 


(69) 


The normalized linear control X* is a handy device in developing 
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the switching theory. In practical application, we can return to the physical 
control u through Eq. (47). Then, the approximate Hamiltonian H* is 
given by 


H* 




1 2 


<"2 - " l * 








u 


(70) 


If singular control to this transformed problem is sought, then we 
have the condition for singtalar arc 


$ 


(H^« - H^*) 



0 


(71) 


and along the singular arc 





(72) 


Once the problem has been solved, and in the case where the suboptimal 
intermediary control u* has been obtained either explicitly as function of 
the time, or in terms of the state variable x, and the time, actual perfor- 
mance can be evaluated using the original state equations which, as 
previously stated, are quasi- linear in the control. The error committed, 
using this approach, is of the order of e = ^^2* ” 

analysis requires further investigation. 


- 41 - 



IV. LINEARIZED SINGULAR CONTROL 


In the case where the control is strongly nonlinear, it may be 
impossible to obtain analytical solution for the Euler- Lagrange type of 
optimal control (Fig. 12), Yet, in the numerical search for the optimal 
trajectory, it is helpful to know an approximate optimal control for this 
type of subarc. In some favorable case, using some physical properties 
of the trajectory, say a certain equilibrium condition, or steady state 
condition which occurs when a certain number of state variables vary 
slowly, one may readily obtain an approximate control u^(x , t) called the 
reference solution. The objective is to improve this solution to obtain a 
better control. 
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If the reference solution is near optimal, then 


H* « H (^,x,u ,t) . (73) 

o o 

Therefore, as first-order approximation we can use the linearized 
Hamiltonian 

, OTjr 

H« = H + (~) (u - u ) . (74) 

o duo o 

Geometrically, this is the same as replacing the domain of maneuvrability, 

near the point u = u , by the tangent at that point. The transformed problem 

o 

is linear in the control u and since the optimal control is not of the boundary 
type, it is singular. We have the condition for the singular control 


(IH 

' 9u^o 


0 


(75) 


By solving the transformed problem, the pertinent state and adjoint 
equations are 


dx ^ 9H* 

dt 


dp 
d t 


9H* 
9 X 


(76) 


Once the problem has been solved, and in the case where the suboptimal 
intermediary control u* has been obtained either explicitly as function of 
the time, or in terms of the state variable x, and the time t, actual 
performance can be evaluated using the original state equations. The error 
committed, using this approach is of the order of e = (9H/9u)^ . Its 
analysis requires further investigation. 
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V . A PPLICA TIONS 


In this section we shall give some applications of the theory 
developed in the previous sections. The first two examples are applications 
of the switching theory developed in Section II, The last two examples are 
illustrations of the theory of quasi- linear control given in Section III, and 
linearized control given in Section IV. 

V. 1 . Smooth Junction With q Odd. 

The dynamical system is governed by 

X . = x^^^ , i=l,...,q; q odd ; q > 1 


q+1 

= u 



1,2 2 


q+2 

= 2 '*2 ■ =‘1 • 

(77) 


with the linear control u subject to the constraint 

- 1 < u < 1 . (78) 


It is assumed that the vector x = (x^^, . . . belongs to a certain 

initial manifold G. at the initial time t. and a certain final manifold 

11 f 

at the final time t^ while 


X ^(t.) = 0, X , -,(tj = minimum 

q+2' i' q+2 f' 


(79) 


This example is given in [16] with q = 1 . 
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The Hamiltonian of the system is 


H = 


E 

i=l 


Pi=^i+1 + Pq+1^ ^ V 2 


( 80 ) 


We notice that Pq ^2 ~ constant = -1. The other adjoint components 
are governed by 


We take 


tJ* ki 

II II 

- "1 
^2 ■ 

Pi 


Pi " 

- Pi-1 

, 1 q^i" 1 • 

(8 1) 

H^* = 

(^)u+ = 

-1 


Hz* = 

(^)u. = 

1 ' 

(82) 


Hence, the switching function is 

= H^* - H * = 2 p , 

2 1 q+1 


(83) 


In evaluating the derivatives Dj^( ) a-nd ( ) , the equations for the adjoints 
are the same, while in the equations for the states, we simply have for 
the components x 

q+1 




- 1 




1 


(84) 
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Taking the derivative of $ q times we have 



-2p = D $ 

q 2 



2 

• 

2 p = D ^ $ 

q-1 2 



• 

• 

$ = 

(-1)'1‘^ 2(x^.p^) = 

d/® 

(85) 

where it should be noted that signs alternate. 

We notice that q is 

odd. 

Q 1 

hence (-1)^ =1. Taking the derivative of the 

last equation in (85) 

q more 

times and applying (77) 

to eliminate time derivatives. 



= 2(^3 + -1> = 

„ q+1 

* 



q+2 

= 2(V*2* ' °2 * 


» 

= 2(x , + X ) = 

' q+1 q- r 

2q-l 

°2 ® 



= 2(x - 1) , 

q 2 

$ = 2(x + 1) . 

q 

(86) 


Hence, the order when q is odd is the order of the singular arc. Also, we 
notice that 


A = ^ ® = 4 


(8 7) 


q 

Hence, the strengthened GLC condition (-1) A < 0 is satisfied, 
at the junction point but everywhere along the singular arc. 

On the singular arc 




2q 

2q 2q 

$ - Dj ^ $ 


2 

2 



) . 


not only 


( 88 ) 
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Ip 


Since 


we have 


Therefore 


u = (1-X*)u^ + = 2\* - 1 


U = — X 


XX + x,x, = 0. 

q q q+i q+i 


In the (x , X ) plane, singular arcs are the circles 

q q +1 


2 2 
X + X 

q q +1 


R 


If we are interested in continuous junction, then either = 0, or 
= 0, Therefore we have the possibilities 

x^ = 1 , junction with u^^ = - 1 
or 

X = -1 , junction with u = +1 . 

q ^ 

Furthermore, since q is odd, r is even. Hence, for junction with Uj^ 


2 q+1 

2q+2 
^ $ 


2 X 

q+1 

-2 < 0 


Without knowing the singular control, from our Theorems 1 and 3 we 
found that its derivative is discontinuous at r = 2. 


For junction with u^ , we have similarly 


(89) 

(90) 

(91) 

(92) 


(93) 

(94) 
have 
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0 


2q+l _ 


2 X 


q+1 


2q+2 ^ T n 

D $ = 2 > 0 

2 


( 95 ) 


For the case of q odd, the theorems only give the necessary conditions. 

This means that, in the (x , x ) plane the only points with possible 

q q+i 

continuous junction for the control, with discontinuity for the second 
derivative, are the points 


X 

q 


X 

q 


1 , X 


q+1 


- 1, X 


q+1 


0 , junction with = - 1 

0 , junction with ~ + 1 • 


(96) 


Furthermore, since all the derivatives in Eq. (86) have to be zero, up to 
2q- 1, we have 


X 


1 



X 


2 


- X 


4 




7(q-i) 

(- 1 ) 

4(q-i) 

(-1) . (,7) 


These equations are valid along the singular arc. Hence, the projection 
of the singular arc into the plane with odd ordered, or even ordered 
coordinates are straight lines. For a pair of coordinates with different 
orders, we notice that 


X 


i+1 


i+1 


X = - X. 

1+2 1 
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Hence, 


X, X. + 
1 1 


X. , X, , 
1+1 1+1 


0 . 


The projections of the singular arc are concentric circles. 

2 


2 2 
X. + X 
1 1+1 


= R. 


i — l,..«,q . 


(98) 


Returning to the points with possible continuous junction for the control, 
since (96) have to be satisfied at the junction point, in addition to (97) 
these relations uniquely determine 2 points for the position vector x = (Xj^ , 
x^, . . . ,x ^^) where continuous junction is possible. The component x 
represents the cost and is additive. It can be taken arbitrarily at the 
junction point if one proposes to construct artificially optimal trajectory 
with continuous junction from that point. 

For example, let us take the point x^ = 1. Then 


X = x„ = X 

1 3 5 


= (- 1 ) 


^( 9 - 1 ) 


"2 ^ "4 


= X = 0. 

q+1 


This junction point is uniquely defined. For the case of q odd the conditions 
are only necessary. We must impose the condition that junction between 
nonsingular and singular subarcs exists, and the junction is made with 
Uj^ = -1. As seen in Table 3, the singular arc can be before or after the 
junction point. If it is before we can integrate backward with u = u^ and 
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forward with u = u = -l to a certain initial manifold G. and a certain 

1 1 

final manifold G^. Hence this type of continuous junction is indeed rare 
and depends on the boundary condition. The equations are simple enough 
so that the integration can be performed easily and the solution obtained 


in closed form. We have the same discussion for junction with u^ = 1 
at the point x = - 1 . 

q 

Before obtaining explicitly the singular control, we would like to 
use our Theorem 4 of Section II to predict that the jump in the discontinuous 
second derivative of the control is 


u - u 
"l 1 


(- 2 ) = 1 


at the junction with u^ = - 1 , and 


u - u = ( 2 ) — — ■■ 

s 2 ^ ’ (-4) 


= -1 


at the junction with u^ = 1 . 


Now, for the singular control, since 


X = X , , X , = u 

q q+1 q+1 


u = -X 


(99) 


the equation for x is 

q 


X + X = 0 

q q 


( 100 ) 


Hence, integrating 


-X = u = C, sin t + C- cos t 
q 12 


( 101 ) 


where C and C are constants of integration. By translation of the time 

'X u 

to t = 0 at the junction point, we see that the singular controls starting at 
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u and u are respectively 

X u 

u = - cos t 

u = cos t . (102) 

"2 

We easily verify the condition of continuity and the j^amp in the second 
derivative as predicted by the theory. 

V. 2. Smooth Ju nction With q Even. 

The following example of smooth junction with q even was given 
by Maurer [17] for a special case of the bo\indary conditions. In light 
of the new information supplied by our theorems the present treatment of 
the problem is general in the sense that we can predict the location of the 
junction points for continuous control and also the boundary manifolds that 
can lead to such junction. 


The dynamical 

system is governed by 


X. = 

1 

X. . i = 1 , . . . , q; q even; q > 2 

1+1 — 


« 

X - = 

q+1 

u 


X ^ = 

q-f 2 

1,2 2, 
2 + *2 > 

(10 3) 


with the linear control u subject to the constraint 

- 1 < u ^ 1 . (1 04) 
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It is assumed that the vector x = (x^, . . . belongs to a certain 

initial manifold G. at the initial time t. and a certain final manifold G. 

11 f 

at the final time t, while 
f 

X ,^{t.) = 0 , X ) = minimum . (105) 

q+2 1 q+2 f 

The treatment is identical to the case of q odd. The difference here is 
that for q even, the conditions stated in Theorems 1 and 3 of Section II 
are also sufficient for a continuous junction for the control. As before, 
the switching function is 

$ = H * - H * = 2p _ . (106) 

2 1 q+1 

The q th derivative of this function is found to be 

$ = (-1)"^“^ 2(x^ - p^) = ® (107) 

with (-1)*^"^ = -1 since q is even. Taking the derivative of this equation 
q more times and noticing that we now have ~ ^ 1 ’ have 



li 

X 

1 

II 




2 (*2 - ^4) = 

Q "l~ 2 , 

D ^ ^ 

c* 



^ <*q-l - Vl’ 

2q-l 

= ‘I $ 



2q 

2(x^+l) , 

$ = 2 (x - 1 ) 

q 

( 108 ) 


Hence, q even is the order of the singular arc. Also, 

A = $ = _ 4 (109) 
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q 

so that for q even, the strengthened GLC condition (- 1 ) A < 0 is 
satisfied, not only at the junction point but also everywhere along the 
singular arc. For the singular control, we have the relation 


u = X 


( 110 ) 


The continuous junction can only be made at = 0 or B^ - 0 , Hence 

at the point of continuous junction 


= - 1 , junction with 


X = 1 , junction with u_ = 1 . 

q Z 


( 111 ) 


Since q is even, by Theorem 1 , r is odd and therefore, at the continuous 
junction with u - 


2q+l 


2 X 


q+1 


- 2 < 0 


( 112 ) 


To satisfy the theorem, for the first non- vanishing derivative, r is odd. 

Therefore x , 5^ 0 and r = 1 . The control at the junction point is 

q+1 

continuous but its derivative is discontinuous. We have the same conclusion 
for the case of junction with u^ = 1 at x^ = 1 . 

Along the singular arc, since all the derivatives of $ up to 2 q-l 
vanish identically, we have 
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( 113 ) 


The projections of the singular arc, in the plane of both odd, or both, even 
ordered coordinates are first bisectors of the axes. 

On the other hand, for a pair of coordinates of different orders 


i + 1 


X = X. 

1+2 1 


Therefore 


X. X. = X. , X. , 
1 1 1+1 1+1 


Upon integrating 


2 2 2 
X. — X, , = + R. 

1 1+1 — 1 


The projections of the singular arc into these planes are equilateral 

hyperbolas, or in the degenerate case, R. = 0, are bisectors in the 

2 

(x^, ) planes. For compatibility with Eq, (113), the are the same 

and we have the equations of the singular arc 
2 2 2 

X. - X = + R ,i=l,3, ..., q+1 

1 q - 

X,, = X^ = . . . = X , (11 

2 4 q 


Maurer considered the case R =0, but in general, the condition imposed 
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is only that the junction point must be at 


"2 = "4 


^ = -3 


. . = X = + 1 

q - 


. . = X = k 

q+1 


( 118 ) 


where k is an arbitrary constant. From these points we can construct the 
optimal trajectory with continuous junction by integrating backward and 
forward. Again we see that boundary conditions are very special and 
continuous junction is indeed rare. Before evaluating the singular control, 
we would like to show that, for this case of q even, we also have sufficient 
condition. 

For junction point with u^^ = -1, x^ = -1, ~ Then at the 

2q 

junction point, froms Eqs. (109) and (112) with $ = 0 


® = 2k , 


d/'J * = -4 . 


(119) 


Then the switching is either the type (11,112) or (13,112) depending on 

whether the value k selected is k > 0 or k < 0. As seen in Table 3, the 

only switching is between nonsingular arc, with u^ , and singular arc. The 

condition is sufficient, and also the direction of switching is determined. 

We have u, -► u for k > 0 and u -► u, for k < 0. 

Is si 

Similarly, for junction point with u^ = 1 , ~ 


have 


$ = 2k , $ = 4 . 


( 120 ) 
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Then the switching is either the type (14, III) or (14,113), depending on 

whether the value of k selected is k > 0, or k < 0. As seen in Table 3, 

the only switching is between nonsingular arc, with u^, and singular arc. 

The direction of switching is given by Theorem 2. We have u^ -► u^ if 

k > 0 and u -»• u if k < 0. The construction of the optimal trajectory 
2 s 

by integrating forward and backward must be based on this theorem. 

Finally, from Theorem 3, we have the jump in the discontinuous 
derivative of the control 

\ M) = 


at the junction with u^^ = -1, and 


- “2 - H) 


k 


at the junction with u^ = !• 

We can easily verify all the results by obtaining the equation for 
the singular control from 


x = x,,x, = u,u = x . ( 121 ) 

q q+1 ’ q+1 q 


Hence 


u = u 


and the solution is 


t -t 

u =C^e + 


( 122 ) 


(123) 
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For junction with , the control is 


- (hzR 
^ 2 


(k+1) -t 
* -- e 


by taking t = 0 at the time of switching. 


For junction with u^, the control is 


(1+k) t , (1-k) -t 

u = e + e 


(124) 


(125) 


The derivative of the singular control has the jump as predicted. The 

example given by Maurer [ 17 ] is the case of junction with u^ and k = 1, 

and also for special case of the initial and final manifold G. and G • 

1 f 

As a concluding remark, it is interesting to notice the following. 
Assume that we are on a singular arc with say, x^ increasing. We also 
recall that 


2q 

= 

2(x +1) 

q 


^ 2q 

Dz ^ 

= 

2(x - 1) . 

q 

(126) 


Suppose that we plan to leave the singular arc at a point -1 < x <1 

q 

to enter a nonsingular arc leading to the final manifold. Then > 0, 

B < 0 and the switching is ot the type (14,112). As seen in Table 2, the 


junction is nonanalytic, and Maurer's conjecture that entering the non- 
singular arc by chattering is correct. When x = 1, D = 0 , so that 

q ^ 

junction is made with u = 1. If the singular arc is not left at this point. 
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2q 2q 

then for x > 1 both D, $ and D. $ are positive and we do not have 

q . 1 2 ^ 

the conditions for a singular arc since they must be of different signs. 


Therefore, the singular arc terminates at x =1. 


V. 3. Example of Qua si- Singular Control. 


The present study is not merely an academic exercise to display a 
certain peculiarity in optimal control theory. It has been motivated by 
an urgent need of mathematical tool in solving a number of engineering 
problems of interest. We shall give two examples in flight mechanics, 
namely the problems of finding the maximum range in thrusting flight and 
in coasting flight of an aerospace vehicle. The flight is to take place in 
the dense layer of the atmosphere. Hence a model of non- rotating Earth 
with constant gravitational acceleration is adequate. 

For flight in a vertical plane, the equations of motion are 


dX 
d t 


dZ 
d t 

d V 


m 



d m 
d t 


“ 

V 

cos 

y 






= 

V 

sin 

y 






= 

T 

cos a 

- 

1 

2 

P 


- mg 

sin Y 

= 

T 

sin a 


1 

2 

P 

2 

SC^ V 

- mg 

cos Y 


= _ - T . (127) 

g 


Standard notation has been used. In particular, a is the angle of attack. 
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measured from the thrust line, and c is the specific fuel consumption, 
assumed constant. The drag polar is assximed parabolic and is of the 
form 


+ K C, 

D D L. 

o 


( 128 ) 


where and K are constant. For most vehicles, parabolic drag polar 


o 

is a good approximation in the range of angle of attack of interest. The 
controls are the angle of attack a , or equivalently the lift coefficient 
, and the thrust magnitude T, subject to the constraint 


0 < T < T 

max 


(129) 


In the first problem, we shall consider the problem of maximizing the 
range in the case of constant altitude, thrusting flight. Hence the flight 
path angle y = 0 , and we have the equations, with the assumption of 
small angle of attack, T cos a ~ T, T sin a ~ Ta 

dX 
d t 

d V 
m ■ - '■ 
d t 

d m 
dt 

The equation for y becomes a constraining relation 

T a + i p S = mg . (131) 

d Xj 


T - 


2 P S Cd V 


- T 


(130) 


Because of this relation, the angle of attack can be expressed in terms of 


T, and the thrust is the unique control of the problem. 

To simplify the problem, several authors [ 28, 29] have ignored 
the small term T a in Eq. (131). Then the equations (130) are linear 
in T, and the variable thrust arc is a singular arc. As has been said in 
the introductory section, that the physical equations are nonlinear in T. 
So it is more rational to use the exact equations and find the suboptimal 
solution rather than using the approximate equations to obtain optimal 
solution. It should be emphasized that neglecting the term T o , or even 
using the approximation T cos a ~ T , can introduce serious errors in 
the analysis of such vehicles as the delta wing type flying at high angle 
of attack in the low speed regime. 

To compare the two approaches, we first solve the linear problem 
by neglecting T in Eq. (131). Then 



3mg 

p S 


(132) 


Using in Eq. (128) for and then in Eq. (130) for the equation in V we 

have the state equations 


dX 
d t 

d V 
dt 

d m 
d t 
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The Hamiltonian of the system is 


II 

Py 

V _ —L 

X 

m 


T 
— - 

m 

We shall take 


(^^T=0 



Hence, the switching function 

$ = 

H^* - 


2 2 K m g 

T ■ 

2 

p S V 


V g ^m' 


max 




max , c 

( p - — m p ) 

m V g m 


According to the general theory, if 


P-. - — m p > 0 , we use , T = T 

V g m 2 max 


p,_ - — m p < 0, we use EL* , T = 0 

V g m 1 


P 


V 


— m p = 0 for a finite time interval, we use 

g m 

T = variable. 


To obtain the direction of switching, we evaluate the derivative 
Noticing that in general 


(134) 


(135) 


(136) 
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d P. 
d t 

dt 


X 


P + ^[pSC V- 

o p S V 


dp 

d t 


m 


V 1 2 

4-f zPSC^ V - 


2 2 

2Km g 
2 

p S V 


] + 


V 


m 


(137) 


we have the derivative D^( ) or ) by simply using T = 0, or T = T 
in the state equations (133) and adjoint equations (137). 

We first notice that 


P = C- (138) 

X 1 

where C ^ is a constant of integration. Furthermore, we have the 
Hamiltonian integral 

H = 0 . (139) 


The derivative is easily found with the help of Eq. (139). Also we 

notice here the usefulness of the relation D ^ Eq. (16), given in 

Section II because the derivative is simpler due to the fact that T = 0 
in all the equations. We have 


$ 


Py ^max 
m^ V 



SC^ V^(l + 
o 


cV 

g 


) 


2Km^g^ 

p S 



(140) 
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Since we maximize the range, > 0, it is seen from the Hamiltonian 

integral that > 0. Then, when a coasting arc, T = 0, is joined with a 

maximum thrust arc, T = T , according to our theory developed in 

Section II, the direction of switching is from T = 0 to T = T if 

max 


$ > 0, that is if 


mg < - p S V 




1 + 


V 

g/ c 


3 + 


V 

g /c 


(141) 


If the inequality reverses, the switching is from T = T to T = 0. 

^ ^ ° max 

Defining the dimensionless quantities 


V 

g/c 


w 


Z m c 
g pS 



(142) 


we can plot the curve 

2 / 1 + u 

w = u 

yf 3 + u 


(14 3) 


in the mass-velocity space (w, u) (Fig. 13). Below this curve, the 

switching is from T = 0 to T = T , while above the curve, the switching 

is from T = T to T = 0. On the curve, we are entering or leaving 

max 

a singular arc. Hence, Eq. (14 1) with equality sign is the equation for 

the singular arc. By taking the derivative of this equation we have a 

relation for evaluating the singular thrust control. This singular curve 

has been found by Hibbs [ 28] for the case of constant and K and by 

o 
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Miele [ 29] in a generalized version, when these characteristics depend 
on the Mach number. The novelty here is our rigorous treatment of the 
direction of the switching. Furthermore, we now consider the case 
where the control is quasi-linear , that is we shall retain the term T a 
in the constraining relation ( 131). 

The lift coefficient C , as function of the angle of attack a is 
given by 


o a 


(144) 


where C and C are two characteristic constant coefficients. Upon 

Lj Xj 

o a 

substituting into Eq. (131) and solving for C , we have 


mg + 


a 


1 2 T 

^psv + — 


a 


The equations of motion now become 


dX 

dt 


d V 
d t 


= V 


■ -- [’ 


1 

- pSC 


D 


2 2 

2Km g 

p S 


(145) 



1 +' 


2T 


pSC^ V 


dm 

dt 


- - T 


(146) 
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As compared to the Eqs. (133), the thrust control is nonlinear, but 
since as has been assumed that the perturbing quantity Ta is small as 
compared to the weight mg, the thrust is characterized as quasi- linear. 

It is possible to linearize the thrust T in Eq. (146), but then we shall 
deal with approximate equations of motion, a situation we sought to avoid. 
We seek to obtain approximate optimal variable thrust control to Eq. (146) 
by constructing the approximate Hamiltonian as given by Eq. (72) 


= p V - 

X 


^ „2 ZKm^g^ 

o p S V 


with the switching function being 



The objective here is to show the correction to the singular curve (14 3), 
so that to simplify the calculation, we linearize the square bracket in 
Eq. (1.48) to obtain 




mg 

2 

p SV 




(149) 
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where 


€ 





O' 


2mg 


S V 



> 0 


(150) 


£ is a small quantity and we shall take it as constant being equal to its 
average value. 

The problem is solved with the approximate Hamiltonian H* , 
with $ as given by Eq. (149). The state and adjoint equations in this 
variational problem are generated by the approximate Hamiltonian H . 
In particular for the derivative D^(), we have 


d V 
dt^ 

d m 

dt. 


m I 2 


p sc^ V + 


2Km g 
2 

p S V 


] 


dp 


V 


dt . 


dp 


m 


dt . 


X V 

p + 

X m 


[ 


pSC^ V - 
o 


4Km^g^ 
p S 


] 


V 

2 


m 


& 


p sc^ - 

o 


2Km^g^ 
D S 


] 


(151) 


The Hamiltonian integral exists, and along the singular arc we have 

P, 


p V = 

X 


m 






S V 




(152) 


which shows that p^^ > 0 since p > 0 . 

^ V X 


Using the Eqs. ( 151) and (152) 
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to evaluate D with $ given by Eq. (149), we have 


= 


2 

m V 




1+ £1. + AliHf 

® p SV^ 


V?) 


2 Km^g^ 
pSV^ 


'3 + + 2^ 

^ ® p s 


V?)] 


(153) 


At a junction point between a coasting arc, T = 0, and a maximum thrust 

arc, T==T ,ifD,$>0, the direction of switching is from T = 0 

max 1 

toT = T . lfD-$<0, the optimal switching is from T = T to 

max 1 max 

T = 0. If ® = 0, the junction is with a singular arc. By taking the 
derivative of the equation = 0, we have the equation for evaluating the 

approximate optimal variable thrust control. Setting D 4> - 0, and using 
the dimersiorlesc variables (142), we have the equation for the singular 
arc 


w 


(l + u+ 3e — ^) = 


w w 

— T (3 + u + e -y) . 


u 


u 


u 


( 154) 


From Eq. (151), we notice that we can write 


e = 


E*C, 


^nag _ 

p S ^o 


a 


(155) 


and E* =l/2^KCj^ is the maximum lift-to-drag ratio. It is seen 

" o 
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that neglecting the component Ta, that is to take e =0, is a good 
approximation when the vehicle has high maximum lift- to- drag ratio. 
Using series expansion we obtain the approximate solution for the 
equation (154). 



0 .1 .2 .3 .4 .5 U 

Fig. 13. The Singular Arc in the (w, u) Space. 
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This curve, for different values of e is plotted in Fig. 13. A typical 
trajectory is also plotted. The initial point (w^, u^) is above the singular 
curve so that the trajectory starts with a maximum thrust arc. When the 
mass w and speed u satisfy relation (156), the trajectory enters a singular 
arc xintil the final mass w^. The trajectory terminates with a coasting 
arc, T = 0, until the speed reaches the final value u^. It is seen that, 
by retaining the component T a of the thrust, singular arc begins and ends 
with a speed slower than the corresponding one for the case where that 
component is neglected. Also, it should be noted that singular arc is 
obtained by approximation. In practice, the control is nonsingular so that 
both the angle of attack and the thrust vary continuously. In the (w, u) plane, 
the exact optimal trajectory, not only is continuous but also has continuous 
derivative. This information is useful for a numerical calculation of 
the true optimal trajectory based on the approximate solution obtained by 
using quasi- singular control. 

V. 4. Example of Linearized Singular Control. 

In this last example, we shall consider the glide of an aerospace 
vehicle. With T = 0, the equations of motion (127) become 
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dX 

dt 


V cos y 


d Z 
dt 

d V 
d t 

d Y 
d t 


V sin Y 

2m 

2m 


g sin y 

^ cos Y 


(157) 


It is proposed to find the angle of attack modulation, or equivalently the 
variation of the lift coefficient, to maximize the range for a given altitude 
drop from Z to Z,. The glide of a shuttle vehicle is an illustrative example- 

if 

We shall use an exponential atmosphere of the form 


Po ^ 


■pz 


(158) 


where p is the inverse of the scale height, assumed constant, and 
is the density of the atmosphere at sea level. We shall use a normalized 
lift coefficient defined as 

C, 


X = 


C^. 




(159) 


where C * = Jc /K is the lift coefficient corresponding to the 

o 

maximum lift-to-drag ratio. If = 2 is the drag coefficient for 

o 

maximum lift-to-drag ratio, we have the normalized drag coefficient 


D 


'D 


1 + X 


(160) 
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The use of the normalized lift coefficient is suggested by the fact that 
when X. = 1 , the flight is at maximiim lift- to- drag ratio. 

It is convenient for the analysis to use the following dimensionless 
variables 


w 


2 (3 m 


u 



X = p X . 


(161) 


The dimensionless kinetic energy u is used to replace the speed while 
the apparent wing loading w is used to replace the altitude. When p varies 
w varies in the same direction as the altitude. Of course x is the 
dimensionless longitudinal distance. With these dimensionless variables 
and using x as the independent variable, we have the dimensionless equations 
of motion 


d w 
~dx 


w tan Y 


d u 
dx 


u( 1 + X 

E* w cos Y 


2 tan Y 


d Y 
dx 


\ J_ 

w cos Y u 


dx 

dx 


1 


(162) 


where E* is the maximum lift- to- drag ratio. In this formulation, the 
only characteristic that enters the equations is the maximxim lift-to-drag 
ratio E=5= and the results obtained are valid for any vehicle, whether it is 



a sail plane with high E* , a fighter aircraft with moderate E* , or a 
shuttle vehicle with low maximum lift-to-drag ratio. The only restriction, 
besides the flat Earth model, and exponential atmosphere, is that the 
speed range is such that the aerodynamic characteristic coefficients are 
independent of the Mach number. 

It is assumed that the lift coefficient is bounded by 


\ . < \ < \ . (163) 

min — — max 


The Hamiltonian of the system is 


H 


p w tan Y 
w 


u 


u( 1 + X ‘ 
E* w CO 


s Y 


+ 2 tan Y 


,1 


J 


+ 


X _ ^ 
w cos Y u 


- \ + P 


X 


(164) 


H is maximized for X=X , ,orX = X ,ora variable X obtained 

min max 

from the equation 9H/ 9X = 0. This gives the optimum relation for lift 
modulation 


X 


E* p 

1 

2 up 

u 


(165) 


Although we have the case of coasting flight, T = 0, this problem is more 
difficult to solve than the previous one because the present control X is 
not linear or quasi- linear but parabolic. It is expressed in terms of p 
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and p by Eq. (165) but in general the equations for p and p cannot be 
u. y "u 

integrated in closed form. Hence, the exact solution for \ is not known. 

We can use linearized theory to obtain a better solution for \ if 
some good approximate solution is known. This can be done in the 
case of steady state glide which occurs for large altitude drop. 

The optimal control depends on the boundary condition. In general, 
for large altitude drop, after some initial maneuver the trajectory stabilizes 
along a variable \, of the Euler- Lagrange type solution, where the variations 
in the speed and the flight path angle are both small. To find the solution 
for steady state glide, we use the assiamption du/dx « 0, dy/dx » 0 in 
Eq. (162) to have 


— tan Y 
\ 


u( 1 + X ^) 
2E* w cos y 

w cos y 
u 


Hence , 


— tan y. 


( 1 + ^ ) 
2 E* X 


(166) 


(167) 


where tan y. has a nearly constant value. On the other hand, from the 
first two equations of system (157), we have 


dX 
d Z 


cotg Y^ 


(168) 


Hence, to maximize the range for a given altitude drop, , we 
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must use the smallest value of - 7 ^ , that is, from Eq. (167), we must 
select 

X = 1 . (169) 

o 


The value y . is given by 


— tan Y . = 


1 

E* 


(170) 


We obtain the classical solution which states that for glide with maximum 
range we must use the flattest glide with maximum lift- to- drag ratio. We 
call this solution the zeroth order solution because it is definitely not the 
optimal solution. It is expected that the optimal solution, when the tra- 
jectory has stabilized in the variable X arc, is near this zeroth order 
solution. Linearized theory based on this solution, as developed in Section 
IV, can be applied in this case. 

Using Eq. (74), we can construct the linearized Hamiltonian using 

the reference solution X =1. 

o 


H'r = p + p w tan Y — 2 p 
X w u 


The state and adjoint equations. 




2 u p 


tan Y - — ^ + (P - 

u w cos Y Y 


u 


E=!= 
(171) 

generated from this Hamiltonian 


) X . 


are 
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d w 
dx 

du 

dx 

d y 

dx 


w tan y 


2 u X 

E* w cos y 


w cos y 


— 2 tan y 
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u 


( 172 ) 


and 


dp. 
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dx 


— p tan V + 
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dp 
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2 p X 
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E=5= w cos y 


p w 
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2p 


+ 
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2 

cos Y 


sin Y 


2 up 


w cos 


(p,- 


u 


E* 




(173) 


The control is variable, so that in the transformed problem, it is singular. 
The switching function is constantly zero and we have 

2 up 


E* 


(174) 


This equation is seen to be derived from the optimal relation (165) when 
the approximation X = 1 is used. By taking the derivative of Eq. (174), 
using the Eqs. (172) and (173), we have 

r ^ 

2p 1 + ^ ^ yH = w 

^ L J 

Again, by taking the derivative of this equation, we have the relation for 
the lift control 
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2 2 

4(1 + E* ) cos y 
3 

E* 


w cos Y 




( 176 ) 


Therefore, we have the first-order solution 


w cos Y 

^1 " u . (177) 

Referring to the exact equations (162) this relation shows that to 
maximize the range we must keep constant flight path angle, a result in 
agreement with standard flight technique. The difference with the maximum 
lift-to-drag ratio glide is that if we use \ = 1, and integrate the equations 
of motion, the resulting flight path angle is not constant, as has been 
assumed in the steady state solution, but presents an oscillatory behavior 
with relatively large amplitude. On the other hand, the exact numerical 
solution obtained also displays an oscillation in the flight path angle near 
a certain reference value, but with smaller amplitude (Fig. 14). This 
reference value is the one that must be used for the first-order solution 
(177). In practice, the initial flight path angle > speed u. and apparent 
wing loading w^ are prescribed. If the average glide angle y can be 
evaluated from the exact numerical solution, one can use a constant 
value X. ^ , to be selected such that the integration leads to 



dx w cos Y u 

when y = y . After that the flight path angle is kept at this constant 
s 
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value by using the first-order solution (177). The convergence of the 
solution by repeated application of the linearized theory requires further 
study. Nevertheless, for the problem of maximum range as considered 
here, it appears that both the zeroth order solution (169) and first-order 
solution (177) provide good results as compared to the exact numerical 
solution, with the first-order solution giving a significant improvement 
over the zeroth order solution. 

This suggests that, again, we can use the first-order solution 
( 177) as a reference solution to linearize the Hamiltonian. We have 


Fw cos Y 
= p + p w tan Y + p I ■ ^ 

^x w * L ^ 
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E* w cos Y 


— 2 tan Y 


1 p 

, p 

2p . 

X + 


" ) 

1 " 

1 w cos Y 

E* / 


) X . (178) 


The state and adjoint equations generated from this Hamiltonian are 


d w 


dx 


w tan Y 

du 
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dx 
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u ^ ^ 2X 

— — - 2 tan Y - 

E* w cos Y * E* 

1 ^ 
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( 179 ) 
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Fig. 14. Variations of the Flight Path Angle and the Dimensionless 
Dynamic Pressure for Glide with Maximxam Range. 
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(180) 


The control is variable, so that in the linearized problem, it is 
singular. We constantly have the switching function vanishing, that is. 


E* p = 2 p w cos Y 

Y u 


(181) 


This equation is seen to be derived from the optimal relation (165) when 

w 

the approximation K = —cos y is used. By taking the derivative of 
Eq. (181), using the Eqs. (179) and (180), we have 


E* wp 

w 



2 2 4 

2 cos Y , cos Y (l + 2u) 

^ ■ u 

E* u 


2 . u sin Y 

w cos Y sio Y + — 


w 


■J ■ 


( 182 ) 


By taking the derivative of this equation we have the relation for the 
lift control 
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X 


w cos Y P 
■q 


(183) 


where 


and 


2 2 2 2 2 2 
P = E* u [ 6 tan Y ” 4u (1-tan y) + 2u tan y + (1+^) C] 

* 2 2 

— 2E u( 3+u) (2+C) w sin Y + 2C(2+C)w cos y 

2 2 2 

Q = E* u [ 2(l+u)tan y - 4u - C] - 2E* u(4+C)wsinY 

o 2 2 

+ o w cos Y 


(184) 


C = 1 - 


u 


2 2 
w cos Y 


(185) 


From the zeroth and first-order solution, Eqs. (169) and (177), it is 
seen that C is a small quantity. 

Equation (18 3) gives the second-order solution for the lift control. 

As compared to the first-order solution, Eq. (177), the ratio P/ Q is the 
correctional factor. The oscillation of this factor near the value 1 
provides the small oscillation in the flight path angle. 

When X = w cos y/n , the flight path angle passes through an 
extremum. Hence by writing P = Q, we have the equation of a surface 
in the ( y. u, w) space 

2 2 2 2 

R = E=i= u [ 2(u +u+2)tan y+ (2+u)c] - 2E* u[ 2(l+u) + (u+2)C] 

2 2 2 

w sin Y + 2(C +2C-4) w cos y = 0 , (186) 
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We notice that the equation for the flight path angle, using the 
variable lift control (18 3), can be written as 


d y 

dx 


R 

uQ 


(187) 


Along the variable lift arc of the trajectory, y remains small and changes 
its direction of variation each time the trajectory intersects the surface 
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R = 0. Hence the variable lift arc presents oscillation in y . The inter- 
section of the surface R = 0 and the plane y = 0 is given by the equation 

[ E-'=^(2+u) - 2] (2+u) + 4] C + 8 = 0 (188) 

where 

2 

C = 1 - . (189) 

w 

Since in general E* > 1, Eq. (188) has positive roots if real roots exist. 
Therefore, the trace of the surface R = 0 in the (u, w) plane is in the region 
w > u. The condition for real roots is 
4 2 2 

E* (2+u) - 24 E* (2+u) + 80 > 0 . (190) 

Explicitly, we have the conditions 

4 2 0 

u < — ^ - 2 , or u > — ^ - 2 . (191) 

E=l= E* 

They are generally satisfied for moderate E^I' and positive u. It is expected 
that the trajectory has a slow variation in y , considering that this variation 
is zero for the first-order solution. Therefore, the variable lift arc stays 
close to the surface R = 0. Using the approximation E* tan y ~ E* sin y ^ 
- 1, cos Y ~ 1 i>^ Eq. (186) we have the following approximate equation for 
the variable lift arc (or linearized singular arc) in the (u, w) plane 
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[ 2(u^+u+2)+E*^(2+u) C] ^ + 2[ 2(l+u)+(u+2)C ] — + 2(C^+2C-4) = 0 

( 192 ) 

where C is given by Eq. (189). 

Using a parameter k defined as 


- = k (193) 

w 


we have a quadratic equation in u 

2k^u^ + [ E=i= ^k^(l-k^) + 2k^ + 2k(3-k^) ] u 

+ 2(l-k)[ E^^\^(l+k)- k\k^+3k - 1] = 0 . (194) 


The two equations (19 3) and (194) can be considered as parametric 
equations for u and w with parameter k. The linearized singular curves 
for different values of E=f« are plotted in Fig. 16. It is seen that for high 
maximum lift-to-drag ratio the curves are close to the curve u = w. 
Furthermore, by the definition (161) of w and u, we see that the dimension- 
less quantity r) defined as 


•n 


u 

w 


p SC_ =!= 

J_J 

2mg 


(195) 


is the dimensionless dynamic pressure which is a measure of the indicated 
speed. Therefore if u ~ w , the indicated speed is nearly constant during 
the glide. 

To support the present linearized theory, exact numerical solution 
has been generated for a vehicle with E* = 10, a typical value for a modern 
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fighter aircraft. The initial conditions used are 


w. = 0. 5, u. = 0. 5, Y- = -0.1 (196) 

11 1 E 

while the final conditions on w and u are 

= 0.215 = 0.213 . ( 197 ) 

The exact numerical solution is plotted in Fig. 16 as a dashed line. It is 
seen that the trajectory nearly follows the singular curve as predicted by 
the theory. In general, for a given m and w. the optimal trajectory, 
for maximum range glide, quickly joins a path near the approximate 
singular curve u « w and stays in its vicinity until near the end when again 
it deviates to match the prescribed final conditions. For a large altitude 
drop, the initial and final arcs are short and, during the main portion 
of the glide, linearized singular control provides the analytical solution 
to the maximum range glide problem. 

The near constancy of the flight path angle y and the dimensionless 
dynamic pressure t) = u/w along the glide path for maximum range is 
explicitly displayed in Fig. 14. 
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Fig. 16 . The Approximate Linearized Singular Arc in the 

(u. w) Plane. 
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VI. CONCLUSION 


In this report, we have presented a comprehensive discussion of 
the problem of singular control. Singular control enters an optimal 
trajectory when the so-called switching function vanishes identically over 
a finite time interval. 

Using the concept of domain of maneuvrability, the problem of 
optimal switching is analyzed. Criteria for the optimal direction of 
switching are presented. The switching, or junction, between nonsingular 
and singular subarcs is examined in detail. It is shown that, in general, 
switching with singular arc is one of two categories: A regular type where 
the control is discontinuous at the junction point, and a singular type where 
not only that the control is discontinuous at the junction point, but is non- 
analytic. In this type of junction, entering or leaving a singular arc is 
effected by chattering control which requires a rapid switching of the 
control between its extreme limits. 

Junction between nonsingular and singular subarcs in which the 
control is continuous at the junction point is a rare phenomenon and usually 
is effected at some specified points in the phase space. Hence, it requires 
particular initial and final manifolds leading to and coming from these 
points. Conditions for smooth junction are derived. The discussion of 
singular arc and junction with singular arc is carried out with the 
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mathematical rigor in optimal control theory. From the more practical 


aspect for solving engineering problems, the concepts of quasi-linear 
control and linearized control are introduced. They are designed for the 
purpose of obtaining approximate solution for the difficult Euler- Lagrange 
type of optimal control when either the dynamical system considered is 
quasi-linear in the control, or in the case of strongly nonlinear control, 
that a certain reference solution for the control, usually steady state case 
control, is known as function of the state variables and the time. 

Some illustrative examples are presented as applications of the 
theorems formulated and of the concepts introduced. 

A logical continuation of this work is the analysis of the error 
committed when quasi-linear control or linearized control theory is 
employed in solving nonlinear control problems. In this respect, a 
rigorous proof that the approximate solution indeed tends to the optimal 
solution is in order. Numerical applications of the linearized theory in 
some engineering problems tend to support this conjecture. 
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